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METHOD AND APPARATUS FOR RETRIEVING ACTIVITY DATA RELATED 
TO AN ACTIVITY 

5 FIELD OF THE INVENTION 

This invention relates to a method and apparatus for processing activity 
data of a process. In particular, the method and apparatus of the present 
invention is concerned with gathering, storing and retrieving activity data of a 
process. 
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BACKGROUND OF THE INVENTION 

A process takes place over a period of time. During the process various 
events occur and various parameters vary in value. There is a need to monitor 
5 a process in order to analyze its performance or of any parameters thereof, 
whether the process is an industrial one for the handling, treatment or flow of 
material or other process, such as the tracking of the weather or of commodities 
or other financial instruments and the like. 

1 0 Current monitoring and processing systems monitor and store events that 

occur during the process and time sampled values (time series data) of the time 
variable parameters of the process. It is necessary to retrieve the process data 
for analysis and reports, for example, trending analysis and reports. The current 
systems have difficulty in retrieving events and time series data of a process. 

15 Generally, custom designed filtering systems are used to determine the events 
and time series data of interest. 

Thus, there is a need for a flexible and efficient method and system for 
processing data that is relevant to a process. 

20 
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SUMMARY OF THE INVENTION 

The method of the present invention frames activity data of a process 
with one or more activities. An activity is something that happened, happens or 
5 is planned to happen over a period of time. The period of time or interval of one 
activity frames, entirely or in part, another activity associated with the 
happening. An activity may have one or more sub-activities, which may have 
one or more sub-sub-activities and so on, thereby resulting in a multi-tier 
hierarchy. 

10 

In a first embodiment of the method of the invention, the activity data is 
collected for a plurality of activities that each have an interval, which occurs 
during said process. The activity data is processed according to a data structure 
that defines the intervals of at least two of the activities such that the interval of 
15 one frames the interval of the other. The processed activity data is stored in a 
memory. 

A second embodiment of the method of the invention retrieves activity 
data of a process that is stored in a memory. First and second activities are 
20 identified. The first activity has a first interval that frames a second interval of 
the second process at least in part. The first and second activities are 
processed to access the memory to retrieve the activity data. 

According to one aspect of the first and second embodiments of the 
25 method, the data structure includes an activity structure that comprises an 

identity and a plurality of attributes of the activities. The attributes of the activity 
structure include a start time and end time of the activity and an equipment or 
item used by the process during the activity. According to another aspect of the 
first and second embodiments of the method, one of the attributes of the 
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structure of one of the activities matches one of the attributes of the other 
activity. 

According to another aspect of the second embodiment of the method, 
5 the second activity is identified with a reference that is either time based, direct 
or indirect with respect to the first activity. The time based reference is with 
respect to a parameter that is independent of the process. The direct reference 
contains a reference by identity to the first activity. The indirect reference 
contains a reference to an equipment or item that is used by the process during 
10 the first activity. 

A first and second embodiment of an apparatus of the present invention 
comprises a computer that performs the method of the first and second method 
embodiments of the invention. 

15 

According to a third embodiment of the method of the present invention, a 
data structure is created with a first predetermined activity that is a source of the 
activity data and that has a first interval and with a second predetermined 
activity that has a second interval. The second interval frames the activity data 
20 at least in part. The activity data is processed according to the data structure for 
storage in a memory. The first and second activities are processed to access 
the memory and store or retrieve the activity data. 

A third embodiment of an apparatus of the present invention comprises a 
25 computer that performs the method of the fourth method embodiment of the 
invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Other and further objects, advantages and features of the present 
invention will be understood by reference to the following specification in 
5 conjunction with the accompanying drawings, in which like reference characters 
denote like elements of structure and: 

Fig. 1 is a block diagram of a system of the present invention for 
processing time series data; 

10 

Fig. 2 is a block diagram of the computer of the Fig. 1 system; 

Fig. 3 depicts an exemplary process, its events, time series data and 
activities; 

15 

Fig. 4 depicts an activity diagram for the Fig. 3 process; 
Fig. 5 depicts a data and event diagram for the Fig. 3 process; 
20 Figs. 6-8 depict data structures for activity framed time series data; 

Figs. 9-1 1 depict data structures for activity framed event data; 
Fig. 12-14 depict data structures for activity framed activity data; and 

25 

Figs. 1 5-1 9 are flow diagrams of the activity framing program of the 
computer of Fig. 2. 
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DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring to Fig. 1 , a system 20 of the present invention includes a 
computer 22, a monitor 24 and a database 24. A network 30 interconnects 
5 computer 22 and database 26 as well as a client device 32. Monitor 26 monitors 
a process 28 and provides process data to computer 22. Computer 22 
processes the data and stores the data in a memory, such as database 26. 
Computer 22 may communicate with database 26 via network 30 or directly, as 
shown by the dashed line 34. 

10 

Database 26 may be a part of the memory of computer 22 or a separate 
database, as shown in Fig. 1 . Computer 22 may be a single computer or a 
plurality of computers interconnected via network 30. Network 30 may be any 
suitable wired or wireless communication network and may include the Internet 
15 an Intranet, the public telephone system and the like. 

Client device 32 may be any suitable computer entry device with a 
capability to communicate with computer 22 via network 30. For example, if 
network 30 is the Internet, client device 32 has a browser capability for Internet 
20 communications. As such, client device 32 may be a personal computer (PC), a 
workstation, a phone or other suitable device. Similarly, computer 22 would be 
equipped with Internet capability to serve files and/or otherwise communicate via 
the Internet. 

25 Referring to Fig. 2, computer 22 includes a processor 34, a 

communications unit 36, a memory 38 and a bus 40. Bus 40 interconnects 
processor 34, communications unit 36 and memory 38. Memory 38 includes an 
operating system 42 and an activity framing program 44. Operating system 42 
controls processor 34 to execute activity framing program 44 to process data of 

30 process 28 monitored by monitor 24. A memory media 46 (e.g., a disk) contains 
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a copy of operating system 42, activity framing program 44 or other software, 
which can be loaded into memory 38. Communications unit 36 includes the 
capability to communicate via network 30. 

5 Activity framing program 44, when run, permits a client to operate client 

device 32 to identify process 28 in terms of events, time variable parameters 
and activities. An event is something that happens at a specific time, for 
example, the triggering of an alarm. Time series data is continuous data of a 
time variable parameter, such as temperature, pressure, flow rate and the like. 

1 0 An activity is a time interval of the process, for example, the operation of a pump 
during the process. 

Activity framing program 44, when run, allows the monitored time series 
data, event data and activity data to be framed by defined activities for later 
1 5 retrieval and access based on the defined activity, attributes thereof and tag 
(identity) of the device that develops the time variable data, e.g., a temperature 
sensor. 

For the purpose of describing the apparatus and method of the invention, 
20 an exemplary process that unloads a material, such as oil, from a ship will be 
initially described. It is understood, of course, that the system and method of 
the invention can be used with any process that has events, time variable 
parameters and/or activities that can be framed by a defined activity. 

25 Referring to Fig. 3, a system 50 is shown for running process 28 for 

pumping out material from a ship 52 into a pair of holding tanks, Tank 1 and 
Tank 2. Ship 52 has a level indicator LI001 that monitors the material level in 
ship 52 during pump out process 28. A temperature monitor T1 01 monitors the 
outside ambient temperature as it can affect pumping performance. Material is 

30 pumped from ship 52 through pipes 54 and passes by a density analyzer A1 001 . 
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The material is pumped to Tank 1 and Tank 2 by a pair of pumps, P101 and 
P102. When a valve V101 is open, the material is pumped by pump P101. 
When a valve V102 is open, the material is pumped by pump P102. A valve 
V1 03 controls the flow of material to Tank 1 and a valve V1 04 controls the flow 
of material to Tank 2. Flow rate to Tank 1 is monitored and controlled a flow 
analyzer FI1 001 . Flow rate to Tank 2 is monitored and controlled by a flow 
analyzer FI1002. A level indicator LI101 monitors the level of material in Tank 1 
and a level indicator LI1 02 monitors the level of material in Tank 2. A motor 
M101 controls an agitator 54 in Tank 1 and a motor M102 controls an agitator 56 
in Tank 2. 

In system 50, the following constraints apply: 

a. Contents of ship 52 do not fit into a single tank. 

b. Only one tank can be filled at a time. 

c. Only one pump can be used at a time. 

Referring to Fig. 4, a number of activities are defined for the pump out 
process of ship 52. The execution of the activities begins at a time TO and 
completes at a time Tn. These activities are as follows: 

1) Analyze activity - This activity continuously monitors analyzer A1 001 
throughout the pump out process from time T) to time Tn and alerts an 
operator if the material density is outside of a specified range. 

2) Unload Ship activity - This activity is a procedure for initiating and 
monitoring the pump out of ship 52. It is the master procedure 
responsible for initiating sub activities: Pumpoutl , Pumpout2, Pumpout3, 
Mix1 , and Mix2. 
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3) Pumpoutl , Pumpout2, Pumpout3 activities - These three pump out 
activities are of the same type, but each uses different settings. A pump 
out activity stops when a tank is full or a failure (e.g. pump failure) occurs. 
In such case, the higher-level activity Unload Ship is responsible to 
schedule another pump out activity with the appropriate settings until ship 
52 is empty. Activity Pumpoutl moves material from ship 52 to Tank 1 . 
Activity Pumpoutl stops when Tank 1 is full. Activity Pumpout2 pumps 
material from ship 52 to Tank 2. Activity Pumpout2 stops when pump 
P101 fails. Activity Pumpout3 uses pump P102 and continues pumping 
material to Tank 2 until ship 52 is empty. 

4) Mix 1 activity - This activity is a procedure responsible for activating 
agitator 54 for Tank 1 . Agitator 54 starts during activity Pumpoutl and 
runs for a period of time after the completion of activity Pumpoutl . 

5) Mix 2 activity - This activity is a procedure responsible for activating 
agitator 56 for Tank 2. Agitator 56 starts during activity Pumpout2 and 
runs for a period of time after the completion of activity Pumpout2. 

These activities can be expressed in a hierarchical order of activity, sub- 
activity and sub-sub-activity as shown in Table 1 . 



TABLE 1 



Activity 


Unload Ship 


Sub-activity 


Pumpoutl 


Sub-sub-activity 


Mix1 


Sub-activity 


Pumpout2 


Sub-sub-activity 


Mix2 


Sub-activity 


Pumpout3 
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I Sub-sub-activity I Mix2 



Referring to Fig. 5, a curve 60 represents the material level in ship 52 
(i.e., the values of level sensor LI001) during the activity Unload Ship. Curve 62 
represents the material level in Tank 1 (i.e., the values of level sensor LI101) 

5 during the sub-activity Pumpoutl . Curve 64 represents the material level in 
Tank 2 (i.e., the values of level sensor LI102) during sub-activity Pumpout2. A 
curve 66 represents the ambient temperature (i.e., the values of temperature 
sensor T1 01) during the activity Unload ship. A curve 68 represents the flow 
rate of material as monitored by flow rate sensor FI1001 during sub-activity 

1 0 Pumpoutl . A curve 70 represents the flow rate of material as monitored by flow 
rate sensor FI1001 during sub-activity Pumpout2. A curve 72 represents the 
flow rate of material as monitored by flow rate sensor FI1002 during sub-activity 
Pumpout3. As can be seen, the outputs of level sensors LI001, LI101 and LI102 
and of flow rate sensors FI1001 and FI1002 vary with time and are continuous 

1 5 or time series data. 

Figs. 3-5 show the execution of the activities and sub-activities required 
to pump out ship 52 over a period of time. At time TO, an instance of activity 
Unload ship is created. The operator would give the instance a name, for 
20 example, UNLOAD_2001_06_01 . The operator would then initiate the activities 
in either an automated or manual manner. 

As the activities are initiated, the process data shows a plurality of events 
74, 76 and 78 that occur during the pump out process. Event 74 represents a 
25 flow change initiated by the operator to increase the flow rate during sub-activity 
Pumpoutl . This flow rate change is monitored by sensor FI1001 . Event 76 
represents a temperature alarm detected when the ambient air temperature 
drops below a safe pump operating range during sub-activity Pumpout2. Event 
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78 represents a failure of pump P101 during sub-activity Pumpout2. As a result 
of the failure of pump P101 , the process switches to the second pump P102. 

Process 28 is initially defined as a data structure that has identified 
activities, sub-activities, sub-sub-activities, attributes, resources (e.g., sensors). 
Throughout the processing of the activities, sub-activities and sub-sub-activities 
of process 28, data is collected pertaining thereto, including time series data and 
event data. The apparatus and method of the present invention uses the data 
structure of activities, sub-activities and sub-sub-activities to frame time series 
data, event data and activity data. The framed data can then be processed, 
stored and retrieved based on the identity of the activity, sub-activity or sub-sub- 
activity, attributes thereof and/or the sensor that monitored the data. Time 
series data can be related to an activity based on time, direct reference or 
indirect reference. These relations will be described with reference to the 
unload ship process example. 

The case of time series data related to an activity based on time will be 
described with reference to Fig. 6. Sub-activity Pumpoutl has two attributes, 
namely a start time and an end time. Each of these attributes has an attribute 
value. Thus, the start time value is August 17, 2000 at 10:00am and the end 
time value is August 17, 2000 at 10:30am. The ambient temperature is not 
directly or indirectly related to the sub-activity Pumpoutl . It is a general reading 
for the whole site and any activity run, or any equipment being used. The time 
series temperature data is related to the time of sub-activity Pumpoutl . Thus, to 
process, store or retrieve the time series temperature data monitored by 
temperature sensor T101 , the identities of the sub-activity Pumpoutl and 
temperature sensor T1 01 are used. 

The case of time series data related to an activity based on direct 
reference will be described with reference to Fig. 7. An activity can have an 
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attribute that is tied to a sensor value (i.e. the value of this attribute is not a 
single value, but its value changes over time). In Fig. 7, Sub-activity Pumpoutl 
has an additional attribute, namely flow rate. The flow rate is tied to flow rate 
sensor FI1001 . The sensor identity (FI1001) is referred to herein as a tag. By 
5 giving an attribute a name (flow rate) and a sensor thereof a tag (FI1 001 ), the 
same attribute (flow rate) can be used for the flow rate variable for a lot of 
different flow rate sensors. The time series data of flow rate sensor F1101 is 
related to sub-activity Pumpoutl by direct reference to the identities of the sub- 
activity, the attribute and the tag of the sensor. Thus, to process, store and 

1 0 retrieve the time series data monitored by flow rate sensor FI1 001 , the identities 
of the sub-activity, the flow rate attribute and the tag of the sensor are used. 
The direct reference case is an option that is used most often in a flexible 
system where devices are allocated at a granular level (e.g. at the pump level, 
as opposed to an equipment unit level, i.e. with all the devices built onto the 

15 equipment). 

m 

The case of time series data related to an activity based on indirect 
O reference will be described with reference to Fig. 8. An activity can have an 

attribute that identifies equipment that is used by the activity. On this 
20 equipment, the user can define a plurality of equipment attributes for different 
parts of the equipment, with each part attribute being tied to a sensor by a tag. 
In Fig. 8, the sub-activity Pumpoutl has an attribute (equipment) that has an 
attribute value for an equipment part, namely Tankl . Attribute value (Tank 1) 
refers to an equipment (Tank 1) that has an attribute (Level) with an associated 
25 tag (sensor L1 101). Thus, an indirect reference through the equipment attribute 
and sub-activity can be used to access time series data of a part of the 
equipment. This option is used most often when a complete equipment unit, 
with all the devices built onto it, is allocated for use by an activity, sub-activity 
and so on. 
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Event data can also be related to an activity based on time, direct 
reference or indirect reference. The case of event data related to an activity 
based on time will yield all events that happened during the activity. 

5 Referring to Figs. 5 and 9, a time based retrieval request for events that 

happened during the activity PumpOut 2identifies temperature alarm 76. The 
retrieval shows that temperature alarm 76 occurred at 10:20am on August 20, 
2000 during sub-activity PumpOut 2. 

10 Referring to Fig. 10, a retrieval request for event 74 (Fig. 5) by direct 

reference to an activity or sub-activity identifies the sub-activity Pumpoutl and 
results in a retrieval of data for events that occurred during the sub-activity. 

Referring to Figs. 5 and 1 1 , event 78 (Fig. 5) and activity Pumpout2 can 
1 5 be indirectly related to each other because they use the same equipment 



fy (referenced by one of their event/activity attributes). 

ry 

An activity can also frame one or more other activities. That is, an activity 
can overlap another activity in whole or in part. An activity can be accessed by 
20 a time based reference, a direct reference or an indirect reference. 



Referring to Fig. 1 2, a retrieval request for those activities that are related 
to a first activity by a time based reference identifies the first activity by name 
(Pumpout3) and essentially requests data of any activity that occurs entirely or 
25 partly during the time of activity Pumpout3. The retrieval identifies the sub-sub- 
activity of Pump Repair. 



Referring to Fig. 13, a retrieval request for an activity by direct reference 
identifies all activities that have a direct reference thereto. Thus, if the request 
30 identifies the activity Unload Ship, data for the activity Analyze is retrieved. 
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Referring to Fig. 14, a retrieval request for an activity by indirect reference 
identifies an equipment attribute and value of Tank 1 thereof. The retrieval 
reveals the sub-activity of Pumpoutl and the sub-sub-activity Mix1. 

5 

Referring to Fig. 1 5, activity program 44 permits a user to define a 
process in terms of the activity/event/time series data structure. For example, 
the definitional data can be developed and identified during an interactive 
session between computer 22 and client device 32 operated by the user. Step 

10 1 00 identifies the activities, sub-activities, sub-sub-activities and so on of the 
process. Step 102 identifies activity type attributes, such as start times and end 
times, time variable parameters (e.g., flow rate), equipment and tags. That is, 
step 1 02 defines the attributes of an activity that frames an event, a time varying 
parameter or another activity. Step 104 accepts activity types defined by step 

15 1 00 and the attributes defined by step 1 02 for entry. 

Step 106 identifies event types, such as temperature alarm 76. Step 108 
identifies event type attributes, such as a time stamp (Fig. 9). Step 1 10 accepts 
event types defined by step 106 and the attributes defined by step 108 for entry. 

20 Step 1 1 2 identifies tags for sensors the monitor time series data. Step 1 1 4 
accepts the tags defined by step 1 1 2. Step 1 1 6 stores the data accepted by 
steps 104, 110 and 1 14 in data base 26 in a manner that permits access by 
activity, event, attributes of either and/or tags. For example, database 26 may 
be physically or logically organized by activity, event, attributes of either and/or 

25 tags. If logically organized, a storage access translator would be used to 
translate the activity, event, attributes of either and/or tag access data into 
physical storage volumes. 

Referring to Fig. 16, activity program 44 also permits the collection of 
30 data during the running of the process, such as process 28. Step 120 identifies 
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that the process has been initiated by the operator or automatically by a control 
system. Step 122 executes activities, such as Pumpoutl (Figs. 4, 6-10 and 14). 
That is, step 122 processes the activity so as to frame the time series data, 
event data and activity data collected with an interval of the activity. Step 124 
5 determines when the step 122 is finished. Step 130 closes the collection of 
activity data. 

Step 126 creates an activity history record, such as attribute values (e.g., 
start time and end time). Step 128 collects event happenings, time stamps and 
1 0 the like for events, such as temperature alarm 76. Step 1 32 processes the 

event happenings and links them to activities of any tier. Step 134 collects time 
series data monitored by the various sensors of the process. 

Step 136 stores the activity, event and time series data in database 26 for 
1 5 retrieval by activity, attribute thereof and/or tag. Step 1 38 retrieves the data 
activity, event, attribute and/or sensor tag for processing or analysis. 

Referring to Fig. 17, time series data of process 28 is retrieved from 
database 26 by activity framing program 44, for example, via an interactive 
20 session with a user operating client device 32. Step 140 identifies an activity 
specified by the user. The activity is matched to the data structure thereof, 
which reveals the attribute that contains a start time and an end time. 

Step 142 identifies a time varying parameter of process 28. If the time 
25 varying parameter, for example, the ambient temperature, is unrelated to the 
activities of the process, a tag identifies it. If the time varying parameter is 
directly related to the identified activity, it will be an attribute of the matched data 
structure and will have the associated tag for the device that monitors the time 
series data of the identified time varying parameter. Alternatively, if the time 
30 varying parameter is indirectly related to the activity, the data structure contains 
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an equipment attribute. The equipment attribute identifies an equipment part, 
time varying parameter and tag for the device. 

Step 144 processes the activity and time varying parameter into a form 
suitable for accessing the time series data of the time varying parameter. For 
example (with reference also to Fig. 7), if the user identifies the flow rate during 
the PumpOut 1 activity, step 144 presents the request in a form useable to 
access database 26. Step 146 then accesses database 26 to retrieve the time 
series data of the flow rate during the PumpOut 1 activity. 

Referring to Fig. 18, event data of process 28 is retrieved from database 
26 by activity framing program 44, for example, via an interactive session with a 
user operating client device 32. Step 160 identifies an activity, for example 
PumpOut 1 or PumpOut 2, specified by the user. The activity is matched to the 
data structure thereof, which reveals the attribute that contains a start time, an 
end time and an equipment. 

Step 162 identifies an event of process 28. If step 162 is identifying an 
event that is not directly related to process 28 based on a time reference, all 
such events that happened during the interval of the activity will be identified. 
For example, if step 160 identifies the activity of PumpOut 2, step 162 will then 
identify temperature alarm 76 and Pump 1 Failure 78 as events that occur 
during the interval of PumpOut 2 (Figs 5 and 9). 

If step 162 is selecting an event that has a direct reference to the activity, 
all events having an attribute that refers to the activity will be selected. For 
example, if step 160 identifies the activity as PumpOut 1 and step 162 requests 
events by direct reference, step 1 62 will then identify the event of Pump Speed 
change 74 (Fig. 10). 
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If step 162 is selecting an event by indirect reference to the activity, all 
events that happened on a given equipment while it was being used by the 
activity will be selected. For example, if step 1 60 identifies the activity of 
Pumpout 2 and step 1 62 requests events by indirect reference, the event of 
5 Pump 1 Failure 78 will be identified (Fig. 11). 

Step 164 processes the activity and event into a form suitable for 
accessing the event data of the event. Step 166 accesses database 26 to 
retrieve the event data of the event that occurred during the interval of the 
1 0 activity. 



Referring to Fig. 1 9, activity data of process 28 is retrieved from database 
26 by activity framing program 44, for example, via an interactive session with a 
user operating client device 32. Step 170 identifies an activity, for example 
15 Unload Ship, PumpOut 1 or Pumpout 3 (Figs. 5 and 12-15), specified by the 
user. The activity is matched to the data structure thereof, which reveals the 
attribute that contains a start time, an end time and an equipment. 



Step 172 identifies a related activity of the activity identified by step 170 
20 that is to be framed. If the related activity is related to the activity based on a 
time reference, all related activities that happened entirely or partly during the 
interval of the activity will be selected. For example, if step 170 identifies the 
activity of PumpOut 3 (Figs. 5 and 12) and step 172 requests related activities 
by a time based reference, step 172 will identify the activity of Pump Repair that 
25 happened partly during the interval of activity PumpOut 3 (Fig. 12). 

If the activity to be framed is directly related to the activity identified by 
step 170, all related activities that have a reference thereto will be selected. For 
example, if step 170 selects the activity of Unload Ship, the related activity of 
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Activity Analyze will be selected (Fig. 13) as it has an attribute value that refers 
to activity of Unload Ship. 



If the activity to be framed is indirectly related to the activity identified by 
5 step 1 70, all related activities that occur entirely or partly during the activity 

interval and that reference the same equipment as the equipment referenced by 
the activity will be selected. For example, if step 170 identifies the activity 
PumpOut 1 that refers to Tank 1 , related activity Mix 1 that also refers to Tank 1 
will be identified (Fig. 14). 

Step 1 74 processes the activity and the related activity into a form 

m 

suitable for accessing the data of the related activity. Step 176 accesses 
HJ database 26 to retrieve the data of the related activity for the interval of the 

UJ 

%a activity. 
15 

HI The present invention having been thus described with particular 

Jjl reference to the preferred forms thereof, it will be obvious that various 

changes and modifications may be made therein without departing from the 
spirit and scope of the present invention as defined in the appended claims. 
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